Týr: blob storage meets built-in transactions
نویسندگان
چکیده
Concurrent Big Data applications often require high-performance storage, as well as ACID (Atomicity, Consis tency, Isolation, Durability) transaction support. Although blobs (binary large objects) are an increasingly popular storage model for such applications, state-of-the-art blob storage systems offer no transaction semantics. This demands users to coordinate data access carefully in order to avoid race conditions, inconsistent writes, overwrites and other problems that cause erratic behavior. We argue there is a gap between existing storage solutions and application requirements, which limits the design of transactionoriented applications. We introduce Ty ́r, the first blob storage system to provide built-in, multiblob transactions, while retaining sequential consistency and high throughput under heavy access concurrency. Ty ́r offers fine-grained random write access to data and in-place atomic operations. Large-scale experiments with a production application from CERN LHC show Ty ́r throughput outperforming state-of-the-art solutions by more than 75%.
منابع مشابه
Managing Databases with Binary Large Objects
We present recommendations on Performance Management for databases supporting Binary Large Objects (BLOB) that, under a wide range of conditions, save both storage space and database transactions processing time. The research shows that for database applications where ad hoc retrieval queries prevail, storing the actual values of BLOBs in the database may be the best choice to achieve better pe...
متن کاملf4: Facebook's Warm BLOB Storage System
Facebook’s corpus of photos, videos, and other Binary Large OBjects (BLOBs) that need to be reliably stored and quickly accessible is massive and continues to grow. As the footprint of BLOBs increases, storing them in our traditional storage system, Haystack, is becoming increasingly inefficient. To increase our storage efficiency, measured in the effective-replication-factor of BLOBs, we exami...
متن کاملIntroduction. Cosmology meets condensed matter.
At first sight, low-temperature condensed-matter physics and early Universe cosmology seem worlds apart. Yet, in the last few years a remarkable synergy has developed between the two. It has emerged that, in terms of their mathematical description, there are surprisingly close parallels between them. This interplay has been the subject of a very successful European Science Foundation (ESF) prog...
متن کاملTo BLOB or Not To BLOB: Large Object Storage in a Database or a Filesystem?
Application designers must decide whether to store large objects (BLOBs) in a filesystem or in a database. Generally, this decision is based on factors such as application simplicity or manageability. Often, system performance affects these factors. Folklore tells us that databases efficiently handle large numbers of small objects, while filesystems are more efficient for large objects. Where i...
متن کاملReduced-Reference Image Quality Assessment based on saliency region extraction
In this paper, a novel saliency theory based RR-IQA metric is introduced. As the human visual system is sensitive to the salient region, evaluating the image quality based on the salient region could increase the accuracy of the algorithm. In order to extract the salient regions, we use blob decomposition (BD) tool as a texture component descriptor. A new method for blob decomposition is propos...
متن کامل